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ABSTRACT 

PROBLEM TO BE SOLVED: To generate a high resolution picture with high 
picture quality by synthesizing a plurality of still pictures. 

SOLUTION: A motion vector arithmetic section 102 obtains a motion vector 
from two pictures [m-th, (m+1)th frames] received continuously and a layout 
section A 103 lays out the 2nd picture to a memory. A data processing 
section 104 processes pixel values of the 1st picture so that the 1st 
picture is well adaptive to the 2nd picture. A layout section B 105 lays 
out the picture that is processed in the memory in response to a vector 
quantity. A synthesis section 106 synthesizes the two pictures arranged in 
the same memory to generate one high resolution picture. The data 
processing section 104 generates a block A consisting of N×N pixels 
from the 1st picture and p-sets (p≥1) blocks in the unit of N×N 
pixels from the 2nd picture, applies orthogonal transform to the blocks and 
generates a block FK consisting of new N×N components by using the 
orthogonal transform coefficient. Inverse orthogonal transform is applied 
to the block FK and the result of transform is laid out with an offset from 
sampling points of the 2nd picture. The picture laid out with the offset 
and the 2nd picture are synthesized. 
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y= (FA (0. 1) -FB ' (0. 
, 1) ) • • • • 5t9 
S4 1 2T?li. ««yl*y=OtgftS**V&, 
[00 5 4] S41 3-C(iS8, &9[Z£<>)»toLtz 
x. y ^a^^A*>^ai^»L^i:4aj»r$ti 

-*AB" = (a' +c X x-a 0. 
[0055] BP*. ?Oy<? Afrf>7Py*B* <^<0l& 

->AB" = (a' -a 0. b 1 - fc 

[00 5 6] &±(07P — |;:-Pl>T. 05~0io£& 
IcLT^blctffgic&^ifS, 05f*:7Py*A£;7P 
y^B' £(Of§ttg§8£;*L*:0-C&&o Invito 
W&tt (aO, bO) . ^P^^B' (0®£j&< (a' . 
b' ) V&Z>Z£ttmftLtzmVVti>& 0 8*1© 
®<OS&tef¥ffifC<J;y ^D^AW^ny^B' <^(D 

****** HUA<»tti£*iTi^ 6 

[0057] 06(*7P-y*B' £:7P'2/*B' <0@21 

6 (a) {i^¥^|aJO)®iZl^Q'y^*^L. ®&*< 
(a' , b' ) V&S>7UyOB' 1 ©&-f O 

£fcf::E&£r^Lk20<0;7P?*£3KLTU£o (1 
U 06 (a) Tl*. ^^D»y^*g=F^lfi3lcrt>L 

0*. &mv*Ltzmmtf&*<Dm&o>mmiz 

£6. 

[00 5 8] fjatfeJ:3(c. Z0)}:*>i>fr0)7uyt 
tf. ^Dy^ciKS*ti^ 06 (b) t? 

r*. S®*isj0^ja^p«y^$^t, ii£a< (a' . 
b' ) vfoZ7ay9B' £4>ifcic 1 BHrt*o±T£B 

bLfc2^^Q7^^LTt^ 0 {§U 06 
(b) fc?P**££^i*|S]frrbLTl** 

c*ii*^p^^(Dffi»i9«$^y^f <&mtz 
fc46(D t cor 6 y . i$Hc(*rhri*i>fc 
is MEic. c<o£**>fr(o:?p »/**><. ^a^^ot 

fc£5C:. £**(0:fp^Ort<:rpt/* A£(OIS:fcg& 
fc&0>® £ 5 WBrlC cfc o T ft 9 a 



frS**W8rt-*. fcU ?FfcLTl**ltf. S4 0 8 
S^bS4 0 9^i«. S408-CI*. E»x 

tf&T<05*T?mii**i$. 

0) ) / (FC (1. 0) -FB ' (1 

A (0. 1) (0<B*<. FB ' (0. 1) omtF 
tU fiteLTlvftlf. S4 1 1^. S#fcS4 1 2^ 
[0 0 5 3] S41 1TM*. £&ytfiaT(05^Cl*tti<* 

1) ) / (FD (0. 1) -FB ' (0 
hlUvO <?n?*B" blfcth) 'MOB*** 

b' +d x y-bO) ^10 

h;l/-»AB" I*. 
O) • • • • i£l 1 

[00 5 9] 07. 08. 09I*. *ft?tim®<D&& 
ii^^Dv^A, 7nytB' . 7P-;/2C<0®f?S 

t/<0rfe£ o 0 7 CO 7 0 Ifim^U— AtfHOSSzJP-y 
£-0&£?Py?A(0©9SI-r— *Tfc$ Q ^P^tM* 
Xf*8x8gj3^<k-r^e 7O2tt^Py^A0DCT« 
. CCOfc&fcft 7 0 2 (m+ 1 ) 

[0 0 6 0] 08(08 0 Hi. ttSUcttlL StSfc 

i4*<^i>^sffi**i/c^p^^B' (ommm^ypito b 

0 21*. fc^KttfflSftfc^P^B' <ODCTfc&fc 
»T?fe£o 7 0 2. 8 0 2ANC,Wq»^J;5lC, gfelte 

[006 1] 09(09 0 m^a^B' (0@^1U 

^^is)ic»»Lfc^p^^c*^*r g cm*. 

1 @im2E»l6]lc^Kitfc^P^^ J: y fcJI&fctfH^i: 

3ii**ira«**ifct(0-efc*o 9 0 2(*^a^^c 
©DCTS6Ma^tt^§o ^P'^^C (9 

02) bJnyttK (702) i:(Oli<ttft^ ^P'V^ 
B' (802) £?P?£A (702) t(OSiai±J;y 

[00 6 2] ZZV % -JUyOB' t 1 gJStrjt/rTJP 

ic. ©*raffi«iurtT?oEB(ass»su^<Ti43teb 

^t^o *Ct?. 04<O7P-Tlx\WLfc«fc5<C. 7 0 
2. 8 0 2. 9 0 2©DCTa:«MW^ACa 
^Kl«»lC^B-rS. l^. 7 0 2(07k¥*iaiAC&* 
^Rfc^l* "36. 37". 802-CI* "35. 50". 
9 0 2-ei* M 4 1. 4 6" V&hOV. C*Vb<OftSJt 
mz±r>X&&*ft.mb. «J*. ffilSW^JIHCtt:^ 

ur^aft/«^^icii»-r*t(ot<BS-r«)bit-c 
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• • ■ it 1 2 . 
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[0 0 6 4] fcfc, ®4T<D7P-|Ifca*T8iWLrt:* 
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Btf 1 1 0 1*611 3£7<Bl¥fffiB&#£/J^fcofc7' 
KL/XA<ffl^**V^. NxN^P^^fkSPl 1 0 211 

B&BBB1 10 31*. 7a?*fl;LfcBBflWB* 
E££»1-*o zfr&affftH BB0>tte*9 HWR 

BKKBflHHBJtLTlMttf. tttf>T«r-*to:&l 
0 4rtfipT?fr5#£li£i\> 

[00 6 7] Bttf=* NXN?Dy^Ml 104,1 
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#»t»«Mt*** \»ji>m#& 1 o 2rt«-ettriL fp 

FK Ci J [J] - (!-«' ) • 

• (1-y' ) ■ F C CM [J] + 
x' • y' - FE C i ] [ j 3 

[007 2] fk [i] [J] II BBKIMrt^a 
y*Kfl>i*#[i] [ j] (&S*B»«S«*LTl* 
x' . y ' II ?a-^B' 0>m&fr£><Dto 



(4 1. 4 6-3 5. 5 0) ±tO. 1 5 • 

ftLTl'Jtl*. »*>Tx-*JlDX»1 04rt©-C?T7<& 

[0 0 6 8] BXKMBBffAtf 1 1 0 6(1 m 
7l/-A@^|^Py^, &tf (m+1) 
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0 6^, *£?&0fl*£oft®T?tfc£o BB&KBB1 
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[0 0 6 9] B 1 2l*BSBBBB*Jftttl 1 0 6(D» 

f^#-iaaa>« 1 <DStt<D»SM*t*:3P-**- h-efc 

m7U-A@(D£§©9&;7P'y*$;7P?£ 
A, (m+1) 7U-Ag<DSffiig«0>g/Nc^Q/z^ 
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7K S P^(SJI= 1 BBttlc-T <bLT;?P-:/*fcLfc20 

?9«;fay9C. HBC. 1ny>?B' ££$icLT 
SB*A l=±T 1 ©^S(C-f bLT?P«y>HbLf::20 
^a^^H. MHBA<'Jt&i*±ra£*tfc?a 
*^*^P«y^Dtn. ?P»^C(0^(Dx 
KB. &tf^O7^D0)IS^a)yffiB$®^if *?P 

septic iu*rortiri>«>ct^^s e 

[0 0 7 0] #7n?9®B£K£ftB6FA . 
fb ' , Fc , FQ tLX* 2 *tc 

BMa>»£-esB» *vd>Bi::»B**. fa 

[3] [5] II ?Dy^ AOSIS (ytt) ;JMHC3« 
(x«) 5 J*#@<DE£«»ttft*iF 

U SBBst-cSBLtcFA (5, 3) t®CX&& a 

BXR»l*8x8B*0DCT£«l=1-*. 
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*o YEStDig^lZH S 1 2 0 4-ei»T©BB^ff*> 
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d-x' ) 
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x* . y' ±\Ztoft*Z>CtlZU* p Wl*»ZZt* 

x' , y' A<?n?*K<0gC/6Kft£ e 

[00 7 3] ±SB5* 1 31*. (m+ 1) 7 b— A@0>4 
O0)?a<y* (Fb ' . Fc , FO. Fe ) 0>(6]-fifc# 

[0074] &c:. s i 2 0 5-eii. £&j£;fc^>h 

7«y?U S 1 20 6T??av*a>*¥i*#A<IS7Lf:: 
frS*£*9S1"£o YEST7fe*lli S 1 203|:g 
tj. NOT&tllfS 1 2 07*C. 

S 1 208T?^a^fl)Ill^^7 
L L. YESOlS^iri^ S 1 202C: 
KU. NO<D<S^fzli6 4fi£^T«l^<SlfT*ti/ri: 

[0 0 7 5] S 1 203T7, N 0 £fl£**lfcJ§ 

SJgft8£te3ILTl*$£*!]E*;K*<DT?. S 1 
2 0 9 VVLT0)&Uti<n?t2tlt> 9 
FK CiJ f i ] — FA [i] [j] • • • 
BP*. SfflaSairi*, m7U-A@(7>gagfeeH&A<ft 

[0076] zo-m<Dtom£®mz®m\,tz0tf®^ 

3Vfo$o 01 3U:fcl*T. . 1 30 1. 1 302. 1 
303. 1 304(4. fWWQy^B' . 
C. 37a*/£D. ?Dy?E<D#:7nv?(&II&&mfc 
(FB ' . Fc . Fq . FE ) S«LTL**. &®m< 
DCfifcttT?. 7a?*<t>4>«tCfr<GE£. **IM*TI= 
ft<«if* ACrtaSJHMlCftft. t\», C0)4^Q 

®aoi 5rt»<D«»«»*«fB(c«fcy^-r* (0 

*»») . CCDtiUfcLfc 1 6tf#(Da&fc»£ 1 3 
0 5 V7ni- Q 

[0 0 7 7] S®aK%4 8ia^(i1 3 0 6-C^L 

fc:/n**A©BS«Mk (Fa ) 0>SS8« (*« 
«) £Ei>£, Bi'fc«IS*aKMB« 1 307^ 

-5- it&®&& 1305. at/a®^« 1307 

££#£t*T. mzUJUvVK (FK ) 1 308^ 

[0 0 7 8] 014-01 9(c^SI8©!S«-r 
-SS&ici&gj-f 01 4i*m7U-Aga>&@;Jq 

y^T?fc«>^D^^ACDlI«m« (a) 
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It (m+1) 7U-ASfl)^ny^B' <0H«m« 

(a) &*0>K£8a (DCT) 0>£&SBffit8 

(b) . 01 6(*^Q-V^C<0©«ffl« (a) £*0>E 

(DCT) 0?att«am« (b) . 017I*?Q 
9 9D0BB1MI (a) ±*0>lSSfcS» (DCT) <0& 

&fc»re*a (b) , @i 8i4^Q7^ea>©«m« 



(a) £*a>H££» (DCT) aKMiBflm (b) 
[0079] L** % tt*¥£4f&x4»t<gELfc« 

ft?ay90B£K£BB0>J»K*iJ. 

02o(oxgi<o<aaic*^ e m*>. x ' = y ' =1/4 

tfty. xgio)tl$^a ^ KOijfifc lt^p t/^ 
(*j<&6 4©m£EB£ti-Tl>< c&icftft. 
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b^bfr£J:5|-. OC^, &UfAC(SB3a«<Dfi2^ 
1*015 (b) . 01 6 (b) .017 <b) .018 

(b) <Dftn£tto>ttBlMtfftA*tL a cuft. 

019 (a) (DBS»Jftl*01 4 (b) 00SaA«O)S 

*«B«jWfcA**iri**. 
[ooautfc, £@£*&raia-c?fe*0i 9 (b) 

At/015 (a) *&D!&frttJ:3lZ % m7U-A@0) 
««* (m+1) 7U-A@t£jfcL-Cti. S»B^< 

[0 0 8 2] &±. ®££&<&ft»ffctf|c<fc*tia®S 
Bft*«M:IS«> 7a ±<Sr«ft7av*S 

ho DCft»fcAC«B*«4>lft0l*. BBtttflllvC 

t, u M«rm« * * « i*. £ti$$mztem< 

[0 0 8 3] *xftoMB-eii. £j§&«0/a#£. n 
<»n±®<»is.m&mt£mZ't£Ti^tz#>iz % <&gft« 
BfcBBlc-f « c t ft < ttVMlcMaOTMfclcjg* 

[0 0 8 4] £fr. ISl±OBWB"e(** 2O<07l/-A0) 

a-rcfcic*y. 7 u-a«sw 

(=f»a©rt»jS«cdj«m*^ttB Lft *l=tt. MR 
^ttlcAtJA^AOBBtttttni-A. Z0lM>fflR|¥ 
SiLri*. @22-024|:*U:^Tf+Ml5> 

[0 0 8 5] 0 2 1li*»^<D«2a>Hffi(0^©^^-r 

<0Sll6a>^l§a)il£«ft«»^«» 1 1 oeizfcitsfli 
31A<Sft$<7)^-e. f6fl0»»i**a-c*«, 02 1 icfc 

^•C. 82101. S220 2l*£B(Daj(H<b*^L. 
SH^IfiJO)Xa i . 7X¥^fS)cD^B j $ -0" IcttSHk 

[0086] «t>r. s2io3«c^L>r. VLTomn 
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FK ' [i] [j] = O-x' ) 
x' - (1-y' ) - Fcli] t j 
] + x' • y' • F£ [i] [j] ■ 
[0 0 8 7] SOTS 2 1 (MirfcHT. VLTOMUtf 
FK (13 [j] =0f [i] [j] 
FA [il [Jl • • ■ - it1 6 
[0088] ZZX. or [i] [j] , 0 [i] [j] 

tzm*ttliiZ&vX : ?to&&2tlTm>o FK [i] 

[ j ] i*h 1 2o>» 1 (0%tta>»fl3&@«Krc. iwacn* 

[00 8 9] 1 0 25» j 

S2 1 06t^Py^fl)*M»WrLfc^ 
SMMt*. YEST?fc*ltf. S2 103ICRIJ. 
NOVtotltts S2 1 0 7-e^gr*E«i ^*^>h7 

a [il [j] -1. * [i] [j 
a [i] [J] = 0.0 [I] [j 

[0091] mi*&x.*ui* ® 1 zonmotemmz 
<. sh««ti*/3 [i] m 

[00 9 2] ^ -ttflHCf*. 
a [i] [j] + /3 [i] [j] =1 v- • ^18 

a [i] [j] + jB [i] [j] <1 ■ • ■ -3*19 

FK [U [j] =ff [i] [j] 

FA C i 1 [ j ] 320 

[0 0 9 5] gp^. &±&KT2fcT-*taI<Dii£££ 



• O-y' ) • FB ' 
] + <1-x' ) • y' 

• • • it 1 5 

• FK ' [i] [j] + * [i] 



[i] [j] + 

• f o m [ j 



[j] 



*S**«5SU YES<Z>ig£f*. S2 102ICHV. 
NO^It 6 4rt»ftrffl»«ffLfci: LT&7 

[0090] *suta>»Br(4. @1 2<&«KDSISfea> 

(m+1) 37U-ABO>t«8FK ' [i] 

m^u-AecomaFA [u [j] tvmtommtm 

Ltl^o a [ i ] [jK0[i] 

1=0 ( i <4frO j <4<Dft) 

] = 1 ubemcdb*) • • . 5t 1 7 

[0 0 9 3] nxsft^a^ic^^as^ 

^if. hhmhw. stfimomtfL* mmz 

xtfx\zm%LtzttWL<»m*&»£mmLtz*2 hnm 
mzmz&wttztf. z*iizm*t0>vitu<* msxa 
±0>®mmo>g#o> 2 &ft#m'Nztj: & 

[0 0 9 4] £tz, "r—ZtoJilzn^Xt* &T(DitCD 
ck^lCfgi^MlCm^U— A|fl>ai^D'^At (m+ 

i) 7u-Aea>gt^©/j\^^^Pt/^'c^^^n 
*?b' (^±<0iI^^aa>^irLrt<fcL\ 
• F B ' [i] [j] +0 [i] [j] • 
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S2 1 



[0 0 9 7] iitKfcOT. q(* (m+1) 7U»A| 
±C=»J*Ufc:/a?$»». pi* (m+1) "7U-AB 
±-Cx-5»toxicfflt^^p^^a. Ofq I^PV^I 

#qK£fr£&»£^LTl,*£o 02 KZ>«-C?r* <m+ 
1) 71/- A0>4:/a*/*££ffil,TOS0>T?* p = 4 

[0098] gp% % m7l/-AS(0;li^Q7^ AtBit 

jKfcltSfc&fcaFA [i] [j] 
fc, (m+1) ?\s--l±Ea>?-*mx.\z&Wmr>fr 



<7>^P^^F q (cfclt^$ft^aFq [i] U3fc<*> 

K U3 [ j ] SSfflUTl^CtlCfcS. 

[0099] 01 2, 02 1 iC^Lfc*^ F 

K HI [j] (OfS^li^^^^tx' , y' 0) 

[0 100] 

[as] 
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t0 10 2] Htz. Vi±0)IStWV\t* l2fcStftt8x8 
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It, ±Xrx>-?U-l*b (m+1) -?\s-Jx<DW&Wfo\Z 
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»; * - \?mzm& l r m l>t * i\ 
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[0 1061*fc, a>ea-*-tT?«ffi)LTl>£OS 
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&*ti&z>rbiT&m+z>zk\z*y % aioso5»L> 
isa^SKo^^gifc^^o dcwacis 

So 
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«aics©a<k u fc®«ffla * tfua-r * c * $ * 0 
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»/*0-efc*o 
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